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Abstract. In this paper several examples of gaps (lacunes) be- 
tween dimensions of maximal and submaximal symmetric models 
are considered, which include investigation of number of indepen- 
dent linear and quadratic integrals of metrics and counting the 
symmetries of geometric structures and differential equations. A 
general result clarifying this effect in the case, when the structure 
is associated to a vector distribution, is proposed. 



Introduction 

Finite type systems in differential geometry and differential equa- 
tions are systems whose solution spaces are finite-dimensional. They 
are encoded by integrable vector distributions on manifolds. Solutions 
of the latter are integral surfaces, which by Frobenius theorem can be 
found through integration of DDEs. 

Several enumeration problems arise in this respect. The most im- 
portant are counting of symmetries and counting of the first integrals. 
Indeed, these object allow to solve the differential equations effectively. 
The larger is their amount, the easier is the integration. 

Notice that symmetries of differential equations can be of different 
types: internal, external, higher etc. Lie-Backlund type theorems in 
some cases identify those, but in general their spaces have different 
sizes. Existence of symmetries is a constraint on the system. 

The models with the maximal amount of symmetries, conservations 
laws etc are of special significance. Usually sub-maximal symmetric 
models play an important role in applications too. 

The setup for the enumeration problem can be: micro-local (the 
objects are defined locally in the space of jets), local (with respect 
to the manifold) or global. While the first two cases are often the 
same (provided we impose the requirement of algebraic behavior for 
the solutions, e.g. considering polynomial in momenta first integrals), 
the latter two are always different: the global existence can have strong 
topological implications. 
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For instance, the number of Killing vector fields locally on 2-disk 
can be only 0, 1 or 3, but globally on it is 0, 1 or 2. Similarly, the 
number of quadratic integrals locally is 1, 2, 3, 4 or 6 [D], but globally 
it can be 2 or 6 on S'^ and 2 or 3 on |Koll IKij . In any case the 
maximal number means constant curvature. 

We will restrict exclusively to local problems, so all differential equa- 
tions and their solutions are defined locally near a regular point. 

The following phenomenon is known classically: the maximal and 
the next after it (sub-maximal) amounts of the objects we count (sym- 
metries, integrals etc) usually have a gap between them. 

For instance the maximal amount of point transformations of 2nd 
order scalar ODEs is 8 (trivializable ODEs with sis algebra of symme- 
tries), elsewise there are no more than 3 symmetries according to A. 
Tresse classification [ElE]- 

In some cases this gap (we stick to usage of this term, resembling 
"spectral gap"; in Russian tradition the word "lacune" is adopted) can 
be explained by the structure theory of simple Lie groups, but in some 
others the algebraic explanation is lacking. 

In this paper we will demonstrate the gap phenomenon in a num- 
ber of examples. In the particular case, when the geometric structures 
are encoded by vector distributions, we remark that the maximal sym- 
metric model is unique and the maximal symmetry algebra is graded. 
Then we give a tool to control the gap. Namely, using recent advances 
in the Tanaka theory, we clarify the behavior of symmetric models and 
we relate this to algebraic and homological methods. 

In general the reason for appearance of the gap and its size remains 
an interesting open problem. 

The paper is organized as follows. In Section [T] we recall the gen- 
eral setup from geometric theory of differential equations, giving the 
method to measure dimensional characteristics we discuss. In Section 
[2] we discuss the automorphisms of geometric structures. Most results 
here are classical. In Section [3] we consider the problem of integrability 
of geodesic flows, and present old and new knowledge on the number 
of second and higher order integrals. 

Then in Section H] we recall basics from the Tanaka theory together 
with a recent progress, and formulate a method to find sub-maximal 
symmetric structures. This will be applied in Section [S] to the geometry 
of rank 2 distributions in manifolds of dimension 5 and 6. The former 
is known since E. Cartan [C] and we give a new interpretation of his 
equations, while the latter will contain new results and we sketch their 
higher- dimensional analogs. 

We finish with conclusion, summarizing the results of the paper. 



THE GAP PHENOMENON FOR FINITE TYPE SYSTEMS 



3 



Acknowledgment. This research was partially supported by the 
grant DAAD project Nr. 208068. I would like to thank Vladimir 
Matveev and other organizers of the conference "Finite Dimensional 
Integrable Systems in Geometry and Mathematical Physics 2011" in 
Jena for hospitality. Some calculations in the last section were per- 
formed using Maple package DifferentialGeometry. 

1. Solution space of differential equations 

The systems discussed in the Introduction can be re-cast into count- 
ing dimensions of the solutions spaces for certain (systems of) differen- 
tial equations. For our purposes we can restrict to linear PDEs. 

A differential equation £ is represented geometrically as a submani- 
fold in the space of jets J^{M, N), where M is the space of independent 
variables x = [x^, . . . jX"") and N is the space of dependent variables 
u = (m^, . . . , ti™"). A choice of these coordinates on = M x N 
yields canonical coordinates on the space J^: (u^), where multi-index 
a = {ii, . . . ,in) has length \a\ = Yla=i < k. 

A system S of differential equations on u = u{x) can be considered 
as a submanifold in jets. We will assume regularity, i.e. the projection 
maps TTfc j : J'^ — )■ J* have constant ranks when restricted to S and its 
prolongations. If S is given by differential equations Fj = of orders kj, 
then the prolongation to jet-order / is given as the locus £i C J\M, N) 
of equations V^jFj = 0, where V„ denotes the total derivative by multi- 
indices a, and the maximal amount of differentiations is |cr| < / — kj. 

The symbols of S are defined as gi = Ker((i7rj^j_i : TSi — )• TEi^i). If 
Xi G £i and 7rj(xj) = x E M, we can identify gi{xi) C S'^T*M ® T^N . 

In general dimgi as a function of i grows in accordance with the 
Hilbert polynomial [KLj . that can be calculated by the characteristic 
variety of £. System £ is said to be of finite type if gi{x) = for large 
i and all x (this holds iff the complex characteristic variety is empty). 

In other words, £ is of finite type if for some jet-level vt; : £i — )■ £i_i 
is a diffeomorphism, i.e. all the jets of u of order / are expressed through 
the lower order jets. This uses regularity assumptions; if we relax the 
latter then the conclusion holds on an open dense set (but gi{x) = 
for large i should hold uniformly in x G M). In this case the solution 
space can be parametrized by the Cauchy data. 

Theorem 1. Dimension of the solution space of a finite type system £ 
is bounded as follows (the sum is finite) 




(1) 



For the regular case, when dim gi{x) are constants, this is a folklore 
classical result; for the general case we refer to IK3I (it is possible to 
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use inf instead of sup in the right hand side; the result also holds for 
analytic £ which have finite type almost everywhere). 

Equality in ([1]) is attained only in the case £ is formally integrable, 
i.e. £ is regular (this assumption we adopt from now on) and VTj j_i : 
£i — )■ £i-i is a vector bundle. The latter means that all compatibility 
conditions of £ hold true. 

Notice that if £ is compatible, the symbols of the prolongations gi can 
be calculated from the symbols of the equation g^ by purely algebraic 
prolongations gi = gl~^^ = gu ® S^-^T*M n S^T*M ® T,iV, but in 
general (non-integrable) case the algebraic prolongations can exceed 
the actual symbol spaces. 

Consider a family of equations £a depending on a numeric or func- 
tional parameter a. The parametrization will be assumed algebraic- 
differential. For instance £ can be the Lie equation describing symme- 
tries of a geometric object and a can parametrize these objects (like 
Riemannian metrics or distributions of prescribed dimensions/type). 
We will assume that the symbol spaces gi calculated algebraically have 
the same dimensions independent of the parameter a. 

In this paper we we would like to understand what are the maximal 
dimensions dimSol(£Q,) and what are the respective structures. This 
corresponds to the parameters a for which £a is formally (and so by 
finite type condition also locally) integrable. 

It turns out that the possible dimensions of dim So1(£q,) usually have 
a gap between the maximal value and the next one. The basic reason 
behind this is the following. Non-maximality means that some com- 
patibility conditions fail, and so new equations shall be added to the 
collection {Fj = 0}. This reduces dimension of some symbol space gi 
and its prolongations, and so the right hand side of ([1]) decreases. 

We are going to demonstrate this effect with examples. 



2. Automorphisms of classical geometric structures 

Riemannian structures or pseudo-Riemannian structures on a 
manifold M always have finite-dimensional isometry groups, which are 
solutions to the Lie equation £ = {[(p]l. : d^^p^g) = g} C J^{M,M). 
The corresponding Lie algebra consists of vector fields ^ satisfying 
L^{g) = 0. The symbols of this equation are (we identify TM ~ T*M 
via g) 

go = T,M, g, = K^T:M, g^ = g? = 0, 

whence dim go = n, dim (71 = Thus the system has finite type 

on the level of 2-jets, 1x2,1 '■ £1^ £\-, and the maximal dimension of the 
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solution space is 
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^ dim gi 



n{n + 1) 



max 



2 



This is realized precisely when £ is compatible, which corresponds 
to the spacial forms (constant sectional curvature), so that locally M 
is round sphere S*", Euclidean space M" or the Lobachevsky space L". 
The symmetry algebras are resp. so(n + 1), so(n) x or so(l,n). 

Let us discuss the submaximal dimension in the Riemannian case. 
The stabilizer of a point subalgebra in so(n). If it is full, the 

translational part at xq should be either of dimension n or zero. In 
the first case we get the constant curvature, in the second - surface 
of revolution. If the isotropy group is proper, then (as maximal) it is 
conjugated to 5o{n — 1), provided n 7^ 4. Thus the metric again gives 
the surface of revolution ds^ = dr"^ + f{r)'^ds'^_i. Translation part is 
full only if the sectional curvature for ds'^_i is constant and to exclude 
the maximal case, we suppose the curvature is non-zero. The gap is 
thus {n — 1) for n 7^ 2,4, i.e. the sub-maximal symmetry algebra of a 
Riemannian metric g has dimension 



The sub-maximal homogeneous Riemannian spaces were described by 
K.Yano, M.Obata and N.Kuiper for n > 4, see ref. in |Kol lYK] . and 
by E.Cartan in dimension 3 and I.Egorov in dimension 4 |Ei| . 

In dimension 2 the submaximal case has dimension 1 (this result be- 
longs to Darboux and Konings [D]), and in dimension 4 the submaximal 
case has dimension 8 - in both cases the gap is 2 [E^. 

In pseudo-Riemannian case the situation is more complicated. The 
maximal case still corresponds to the manifold of constant sectional 
curvature M"'(c), i.e. locally Minkovsky or Wolf space. The submaxi- 
mal case has the same dimension of the symmetry algebra in the case 
of Lorenzian signature and n 7^ 3,5, but the amount of submaximal 
cases is greater. According to [PJ for n > 5, n 7 locally they are: 
products M"'~^{c) x R, e-spaces and Egorov spaces. 

AfRne structure is given by a choice of affine connection on M. 
The Lie equation for symmetries S C J'^{M, M) at some point X2 & £ 
with 712(0:2) = X has symbols go = T^M, gi = T*M ® T^M, g2 = 0. 

Thus the symmetry algebra of the affine connection has dimension 
at most 
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n + n^. 
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The equality is attained iff 8 is compatible, and this happens precisely 
when M is the usual affine space with ffat connection [Ei]. The sub- 
maximal case for n > 4 has dimension 

®sub.max ^ • 

Almost complex structure is a field of operators J on TM sat- 
isfying = — 1. If the Nijenhuis tensor Nj vanishes, the structure is 
integrable and the local symmetry pseudogroup is infinite-dimensional. 
To guarantee finite-dimensionality one imposes a non-degeneracy con- 
dition on the Nijenhuis tensor [K4]. If n = dim^M > 2, this says that 
the image N j{A^T M) is the whole TM. For n = 2 it is enough to 
claim that the image be a non-holonomic rank 2 distribution. 

Provided the dimension of the symmetry group is finite what is its 
maximal value? We know the definite answer for n = 3. According to 



K4I the maximal symmetric non-degenerate almost complex structure 
is the Calabi structure J on S"^, the symmetry group being G2. We do 
not know the submaximal model for certain, but expect its symmetry 
algebra to be 9-dimensional (then the gap will be equal to 5). 

Conformal structure is given by a choice of conformal class of 
(pseudo-)Riemannian metric. The Lie equation £ C J^(M, M) for 
n > 2 has symbols go = T^M, gi = co{n) = M © so(n) ~ M © A'^T*M, 
g2 = T*M and gs = 0. Thus 

_ (n+l)(n + 2) 

*^max 2 

Equality is attained in conformally flat case (loc. Euclidean space M"). 
The same is true for the signature {p, n — pjj. 

Projective structure can be given as a projective class of torsion 
free connection on M. The symbols of its Lie equation are go = T^M, 
gi = T*M © T^M, g2 = T*M and ^3 = 0. Thus 

©max = + 2n. 

Equality is attained in projectively flat case (loc. MP""), see [Koj . We 
do not know submaximal cases for conformal and projective structures. 

Closely related to projective equivalences are geodesic equivalences 
between Riemannian manifolds. The counting function for the latter 
- the degree of geodesic mobility - has lacunarity similar to that 
in the theory of motion. See |KM^S] and the references therein for 
complete description of gaps in the distribution of the degree of geodesic 



^Added in proof: after discussion with M.Dunajski and K.Melnik it became clear 
that the sub-maximal model in dimension n = A and neutral signature is given by 
the so-called pp-waves metric. This is the anti-self-dual twist free, constant curva- 
ture solution of the Einstein equations [Duj . Its symmetry algebra has dimension 
9, and so the gap is 6 in this case. 
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mobility. The maximal and sub-maximal degrees of geodesic mobility 
for n > 2 are 

_ (n + l)in + 2) _ (n-l)(n-2) , ^ 

"^max 2 ' '^sub.max ^ ~r i-- 

Thus the gap is 3n — 1. The dimension of concircular fields, which are 
projective analogs of the Killing fileds, have gap 3 as for them 

®max IT' ~\~ ^1 ®sub.max ^ 2. 

That degree of geodesic mobility exceeds 2 is closely related to inte- 
grability of geodesic flows |MTj . which is discussed in the next section 
(in particular for n = 2, when the degree of geodesic mobility equals 
dimQ2, see ([2]), we observe that the maximal case has the same dimen- 
sion as prescribed above, namely ©max = 6, while the sub-maximal 
case has dimension ©sub.max = 4). 

3. Integrals of geodesic flows 

Let (M, g) be a Riemannian or pseudo-Riemannian manifold. The 
geodesic flow of g is the dynamical system on T*M (with the canonical 
symplectic form) given by the Hamiltonian H = = \g^^ 

Its integrability via functions analytic in momenta is equivalent, by 
Whittaker's theorem, to existence of polynomial in momenta integrals. 
Since H is quadratic we can restrict to integrals of pure degree d. 

Consider the vector space ({, } denotes the standard Poisson bracket) 

Q^[g) = {F e C^{T*M) ■ {H, F} = and deg F = d}. (2) 

We will be interested in its dimension depending on g. The whole 
algebra of polynomial integrals Q{g) = ®Qd{g) is graded and Poisson, 
satisfying {Qk.Qi} C Qk+i-i- 

Linear integrals, also known as Killing vector fields, have the form 
F = u^{x)pk- The coefficients of the quadratic expression {H,F} = 
give a system £ of "'•"^"'"'''^ equations on n unknown functions. The 
symbols of S have the following dimensions (interpreted as the number 
of free jets, or as the amount of Cauchy data): 

dim5fo = '^, dim5fi = n = , dim = 0. 

Its easy to see that this is the Lie equation for the Riemannian metric 
g - the case discussed in §2J 

Solution to this £ gives the Lie algebra sjm^g) = Qi{g). The other 
spaces Qd{g) are not Lie algebras, but are modules over Qi{g). 

Quadratic integrals, also known as Killing-Stackel 2-tensors, have 
the form F = u^\x)pkPi- The coefficients of the cubic expression 
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{H, F} = give a system S of "("+^K"+2) equations on dim go = 
unknowns. The higher symbols of £ have the following dimensions: 

n{n' - 1) n^n' - 1) 
dim 5^1 = ^ , dim 5^2 = ^2 ' dim 5^3 = 0. 

Thus the system has finite type on the level of 3-jets, 71^,2 ■ £3 -> £2, 
and the maximal dimension of the solution space is 



©max = ^ dim 



9i 



(n + l)2((n + 1)2-1) 



12 

This is realized precisely when S is compatible, which corresponds to 
the spacial forms (it works also for the pseudo-Riemannian case). 

In fact, the maximal space of quadratic integrals Q2 = S^Qi. This 
means that quadratic integrals are linear combinations of the products 
of the linear ones. For instance, for the flat case Qi = (pfc, r^j = XiPj — 
XjPi), so Q2 is generated by go = (piPj), gi = {Lijk = TijPk) (relations 
are L^jk = —Ljik and Lijk + Ljki + Lkij = 0) and g2 = {Rijki = ^ij^ki) 
(relations are the same as for algebraic curvature tensors). 

Proposition 2. Suhmaximal symmetric Riemannian metrics have di- 
mension of the solution space Q2 given by 

n{n + 1) v?{p? — 1) 



^ sub.max ^ ^ ~l~ 
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In fact we expect that the above is the submaximal number of qua- 
dratic integrals. The claim follows from the following 

Lemma 1. For the metric g = xi J2i dxf 

A- n ( \ ^(^+1) , ^^(n^-l) 
dimg2(y) = — ^ — + — - — ■ 

Proof. The Hamiltonian is H = ^^pj- Let F = Yli^ijPiPj a 
quadratic integral. The condition {i?, F} = is equivalent to the PDE 
system on functions 6^ = bij{x). The coefficient of p\ gives 

dhi _ hi _ (3{X2, ...,Xn) 

— — =^ Oil — ■ 

0x1 Xi Xi 

The coefficients of pfpi for i > 1 give 

O ^^1* , A , n ^ ^ ai{x2,...,Xn) 0/3 

2xi- ^bii + — ^0 ^ bii^ — — . 

0x1 oxi ^xi axi 

The coefficients oipipj and piPiPj for i,j>l give 

'dai ^ daj\ ^ 5^/3 , /3 



bi, = nj{x2, . . . , x„) - 2v/^(^ + 9^ j + + -5.,. 
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Substituting these expressions into the coefficients of , p'^pj and piPjPk 
and separating different powers of Xi we obtain that ^ is arbitrary in- 
homogeneous quadric, a = and r correspond to the (maximal) space 
of Killing 2-tensors in (n — 1) dimensions. Since the inhomogeneous 
quadrics in (n — 1) dimensions are bijective with homogeneous quadrics 
in n dimensions, we are done. □ 

Notice that for the above structure dimQi(g) ~ i^i^-^) ^ n > 1, so 
that for n > 2 it is not sub-maximal for the dimension of Killing fields. 
Let us consider sub-maximal metrics for dimQi; they turn out to be 
not submaximal for the dimension of Killing 2-tensors. 

Lemma 2. For n > 2 and the metric g = dxf -\-dsf^_-^, where the latter 
is a metric on D^~^{x2, ■ ■ ■ , Xn) of constant sectional curvature 0, 

^ , , ^ n(n - 1) n^(n^ - 1) 
dimQ2(^7) = 1 + ^ + -■ 

Proof. We will consider only the case of positive curvature c > 0. Using 
stereographic coordinates on Af"^^(c) the Hamiltonian on T*M writes 

H = pI + {R^ + xl + --- + xI)\pI + ...+pI). 

The Killing fields (written as functions on T*M) are 

n n 

Ki = pi, Kf = (-R^ - 5Z '^i)^* + 5Z ^^P^' ^ ^'P^ ~ ^^P' 

2 2 

(the indices i,j run from 2 to n). 

Write the quadratic integral F = ap\ + PiYl^^iPi + T^i j>i^ijPiP3- 
The coefficients of p\ in the equation {if, F} = yields ^ = 0. Then 
the coefficients of p\pi yields hi = h^ — {B? + x\-\- ■ ■ ■ + x^) Xi-^, where 

b° = b'^{x2, . . .,Xn), i > 1. 

The coefficients of PiPjPk with i,j,k > 1 yield the condition that 

Ylij>i (^ijPiPj ^ Killing 2-tcnsor of the metric c?s^_i. Since the latter 
has constant sectional curvature, we conclude that this contribution 
to F is generated by pairwise products of Killing fields in (n — 1) 
dimension: 

Substituting this and evaluating the coefficient of PiPiPj we obtain 
certain expressions linear in Xi, for which free terms mean that ^Pi 
is a KiUing fields for rfs^.^. Thus it is a linear combination of K^, K}j. 

The coefficients of xi give a system on a = a{x2, ■ ■ ■ , Xn) of the second 
order in Frobenius form (its second symbol vanish g2 = 0). But it is 
inconsistent - the compatibility conditions give a = const. The claim 
follows. □ 
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Let us notice that in the case of Lemma [2] we have Q2{g) = S'^Qi{g), 
but this equahty is wrong in the case of Lemma [TJ 

Cubic and higher degree integrals. In any order d and dimension 
n the quantity dim Qd{g) attains maximum precisely when is a spacial 
form. In addition Qd{g) = S'^Qiig) for such metrics g. 

Almost nothing is known about sub maximal cases, except for n = 2. 
Consider the latter case. It was shown in |Ki| that for d = 3 and g 
being of non-constant curvature dimQslg) < 7 (for the maximal case 
this dimension is 10). Thus the gap is at least 4, and we conjectured 
it is 6 (i.e. submaximal dimQs = 4 the same as submaximal dimQ2)- 

This conjecture was proved under additional assumption that g has 
a Killing field in [MS] . The assumption looks natural - one expects 
from experience with degree d = 2 that the metric of submaximal type 
possesses an additional linear integral. 

Let us notice that the success of the above approach is related to 
the fact that given H, the system {H, F} = on coefficients of F is 
overdetermined and of finite type. If we consider both H and F as 
unknowns, the situation changes (we treat only the local case). 

Denote by S the system on coefficients of H, F. If one of A; = deg H 
or / = degF equals to 1, then £ is underdetermined (implying existence 
of functional families of solutions). So we assume I > k > 1 and use 
the identity deg{H, F} = k + 1 -1. 

In dimension n = 2, due to existence of isothermal coordinates, the 
system is determined for all k, I. In particular, for = 2 it has the 
structure of semi-Hamiltonian system of hydrodynamic type [BM] . 

For n = 3 the system S is underdetermined for = 2, / = 2, 3 and 
determined for (fc, /) = (2,4). For n = 4 it is determined for {k,l) = 
(2, 2). For all other parameters and for > 5 ^ is overdetermined (so 
dimensional restrictions on its solution space are expected). 

4. TaNAKA THEORY: OLD AND NEW 

Tanaka theory [T] describes symmetries (automorphisms) of vector 
distributions A C TM. With every such distribution one associates 
the graded Tanaka algebra q defined as follows. 

Define the weak derived fiag {Aj} through the module of its sections 
by r(Ai+i) = [r(A),r(Ai)] with Ai = A. We assume that our dis- 
tribution is completely non-holonomic, i.e. A^ = TM for some k, and 
that A is regular, i.e. ranks of Aj are constant along M. 

The quotient sheaf m = ©i<ofi'i, gi = A_j/A_j_i has a natural struc- 
ture of a graded nilpotent Lie algebra at any point x G M. The bracket 
on m is induced by the commutator of vector fields on M. Distribution 
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A is called strongly regular if m(x), as a Lie algebra, does not depend 
on the choice of x G M. 

The Tanaka prolongation g = m © g+ = © . . . g_i © 0o © 0i © • • • 
is the maximal graded Lie algebra with negative graded part equal 
to m. The non-negative part g+ is a subalgebra, and it a-priori can 
be infinite-dimensional. The graded components can be calculated al- 
gorithmically, see [H lAKj . For instance go is the space of grading 
preserving derivations of m. 

For strongly regular distributions N. Tanaka constructed an absolute 
parallelism on the prolongation manifold, and this gives the way to 
define curvature and flatness [T]. In particular, it shows the standard 
model (Exp(m), g_i) gives the maximal symmetric distribution (among 
strongly regular distributions) with the symmetry algebra g. 

The condition of strong regularity was removed in IK3I . The follow- 
ing statement is a combination of results in [Kaj lAKj (dimensional part 
is a paraphrase of Theorem [U in the first part of the theorem sup can 
be changed to inf). 

Theorem 3. Let A he of finite type, i.e. for some k we have: Qi{x) = 0, 
for all i > k, X E M . Then its symmetry algebra is majorized by the 
Tanaka algebra g in the sense 



dimsym(A) < sup dim gj(x). 



M 

■I 

This inequality is an equality if and only if the distribution A is flat. 

Thus the maximal symmetry model is unique (isomorphic to the 
standard model), which is not the case with maximal cases for other 
geometric structures. 



The following statement re-phrases Theorem 3 from K3 



Theorem 4. Let h be a Lie algebra symmetry of a distribution A on 
a manifold M, and let g be the Tanaka algebra of A. Then there exists 
a Lie algebra compatible filtration Fi of h such that the corresponding 
graded Lie algebra is a subalgebra of the Tanaka algebra: C g. 

This is to be compared to the following result of R. Zimmer [Z] 
(which uses the assumption gi{x) C sliT^M) instead of grading). 

Theorem 5. Let M be a compact group, G a real algebraic group acting 
on M by volume-preserving transformations and P be a G-structure. 
Then Lie algebra f) = sym(P) embeds into g = Lie(G). 

Theorem H] can be applied as follows. 

Corollary 6. Any sub-maximal symmetric case is obtained via the 
following construction. 
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Consider a subalgebra f) C g and let h be a filtered Lie algebra that 
cannot be monomorphically mapped into q (as a filtered algebra), but 
whose associated graded Lie algebra equals f). 

Suppose that h has a subalgebra ho of dimension dimg — dimM and 
that for a vector subspace U G h of dimension equal to rank(A) we 
have: [ho, 11] cho + U, /iq n 11 = 0. 

// the iterated brackets of ho + 11 generate h, then the homogeneous 
space H/Ho (where H,Ho are the corresponding Lie groups) possesses 
H -invariant nonholonomic distribution corresponding to U. 

We call such an algebra h a deformation of f). Notice that if /i C 3 
then the symmetry algebra of the distribution on H/Ho will be q, i.e. 
the maximal instead of sub-maximal case. 

First obstructions to deformations of Lie algebra structure are given 
by H'^{i), f)). These cohomology groups can be however non-zero even 
in rigid cases (this is what often happens when f) is not semi-simple). 
We will see an example of this in the next section. 

5. Symmetries of rank 2 distributions 

Consider rank 2 distributions, at first in 5-dimensional space. Ac- 
cording to Goursat [G] they are encoded as Monge underdetermined 
ODEs 

y' = F{x,y,z,z',z"). (3) 

The equation-manifold M^(x, y, z, 2:1, 2:2) is equipped with the Pfaffian 
system {dz — zidx, dzi — Z2dx, dy — Fdx} and the rank 2 distribution 
(Vrc = dx + zid-^ + Z2d-^^ + Fdy, d^^) is dual to it. 

Internal symmetries of ([3]) are by definition the symmetries (auto- 
morphisms) of this distribution. 

Condition Fz^z2 guarantees that the symmetry algebra is finite- 
dimensional. In this case E. Cartan [C] showed that the dimension is 
bounded by 14, and in the case of equality the maximal group is G2- 
The maximal symmetric model is unique up to equivalence and it is 
given by the celebrated Hilbert-Cartan equation 

y' = {z"f- (4) 

What about sub-maximal cases? They all are given by the follow- 
ing Monge equations (in ^ overdetermined involutive 2nd order PDE 
systems on the plane were classified, but it is not difficult to establish 
the equivalence): 

y' = {^'T- (5) 

Here m = 0, 1 corresponds to the case of Engel distribution in which 
has the contact pseudogroup of symmetries; if 2m — 1 G {±i,±3} the 
equation is equivalent to (jl]) and its symmetry is the exceptional Lie 



THE GAP PHENOMENON FOR FINITE TYPE SYSTEMS 13 

group G2', for other cases the group of symmetries g has dimension 7 
(m G M is the only invariant of both the group and the equation) and 
is given in generators as foUows: 

symi©} = {Wi = d,, W2 = dy, = 5„ = xd,+ydy+2zd,+z^d,,, 
W5 = xdz + O^^.Wq = mydy + zd^ + zid^^ + Z2dz^,W7 = 

z^-'d, + {m-l)j zl^-'dz2 ■ dy + {z,z:^-' - + (1 - )• 

Abstractly the Lie algebra structure reads off from the structure equa- 
tions on p. 169 [C]. In the basis (Xi, X2, X3, X4, X5, Yi, Y2) dual to the 
Cartan coframe (wi, uj2, W3, W4, W5, wi, W2) the non-trivial commutators 
are 

[Xi, Fi] = 2X1, [X2, Y2] = Xi, [X3, X4] = Xi, 
[X2, Fi] = X2, [X3, Fi] = X3, [X4, Fi] = X4, [F2, = Y2, 
[X2, X5] = (/X3 + F2), [X3, X5] = (X2 + I/X4), 
[X4, X5] = (X3 - IY2), [X5, Y2] = X4. 

The parameter J is a semi-invariant and is a bona-fide invariant 
(Cartan [C] writes that I is obtained from the forth root, so some 
power of it is an invariant; we shall see that this power is 2). 

The above description of q is however not convenient, since the re- 
striction of ad(X5) to the derived algebra 02 = (Xi, X2, X3, X4, F2) is 
not normalized (ad(Yi) acts like the grading element). This operator is 
semi-simple and diagonalizing it (changing the basis in (X2, X3, X4, Y2)) 
is equivalent to passing to the basis {VFi}J^;^. 

In this new basis the description of q is the following. The derived se- 
ries is 02 = {Wi, W2, W3, W5, W7), 03 = {W3), and 02 is the Heisenberg 
algebra [) = © [)_2 (now indices denote the grading) given by the 
symplectic form on f)_i = {Wi, W2, W5, W-^) with values in f)_2 = {W3). 
In other words, the non-trivial brackets are 

[WuW,] = W3, [W2,W7] = ^W3 

(we keep the normalizing factor). 

This is extended to [) = [)©M-W4 by the grading element ad(W4)|[,^. = 
k ■ id. Finally is obtained from I) by right extension via the element 
in H^{i), [)) given as follows (m 7^ 1/2): 

- ad(W6) = mW2 ® ^2 + ® ^3 + ® ^5 + (1 - m)W7 (g) 67 

{Oi is the coframe dual to Wi). 

Subtracting the trace we get the operator A = adiW^ — ^W^) on f)_i 
(it vanishes on f)_2), whose conformal class is an invariant of the Lie 
algebra 0. 
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From the spectrum Sp(yl) = {±|, ±(| — m)} we obtain the absolute 
invariant A = Tr(yl^)/ Tr(A^)^. Passing to 2(1— 2A) we get the invariant 

(l-2m)2 
~ (1 -2m + 2m2)2' 

Calculating the invariant J in the Cartan basis (using ad(X5)) we get 
J = ^(1 + l "^)- Now we can relate the parameters: 

^ _^ i(l - 2m + 2m^) 

2^J{m + l)(m - 1/3) (m - 2/3) (m - 2) ' 

We see that poles of / correspond to maximal finite-dimensional sym- 
metry algebra G2, while linearizable cases correspond to J = ib|. 

For the exceptional case m = 1/2 the spectrum is multiple (this 
happens also for m = 0, 1), and this is the only case, when A is not 
semi- simple: 

- ad{We - \Wi) = IW5 ® ^5 - |m ® ^1 + ® 9y. 

It is more convenient to describe the equivalence classes in terms of 
the parameter k = 2m — 1. On the real line ]R^(/c) we have the action 
of the group Z2 © Z2 with generators k ^-^ —k, k (the latter 

is not defined at 0). Its orbits correspond to the equivalent Monge 
equations ([5]). In particular, the cases of symmetry dimensions 00 and 
14 corresponds to the orbits of A; = 1 and k = 3, and the exceptional 
case of Jordan block corresponds to A; = 0. The orbit space is the union 
of two /c-intervals [0, 1/3] U [1/3, 1]. The invariant I expresses via k so: 

r2 _ jk' + 1)^ 

(F_9)(i/9_fc2)- 

Consider the next case of rank 2 distributions in M®, which are not 
reducible to the previous case of (2, 5)-distributions. Then \DZ\ lAKj 
its symmetry algebra is at most 11-dimensional. It is enough to re- 
strict to the following Monge equations in this case (in dimension 6 
not all rank 2 distributions are realized as this underdetermined ODE, 
the other two cases correspond to hyperbolic structures involving only 
second derivatives and the elliptic structures that can be realized only 
as Monge systems |AK] but their symmetry algebras are at most 8- 
dimensional) 

y' = Fix,y,z,z',z",z"'). 

Non-degeneracy condition -F2323 7^ is sufficient for finite-dimensionality. 
Here the maximal symmetric model is unique and is given by 



y' = {z"'f. 



(6) 
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We refer to [AKj for the description of the symmetry algebra (both as 
internal and as external higher symmetries). 

The submaximal case is given by the family (e G C) 

y' = {z"'f + e\z")\ (7) 

The symmetry algebra is 9-dimensional and is represented as follows: 

sym{(17D} = (PFi = 9,, W2 = dy, Ws = d,, 

Wi = 2ydy + zd;, + zid^^ + 22^22 + ^3^23) ^5 = xd^ + S^,, 
1^6 = ^e^zidy + \x^d^ + xd^^ + d^^, 
= 2{z2 + e^ixzi - z))dy + ^x^d, + ^x^d^^ + xd^^ + d^^, 



= e'%2e'z,dy + + ed,, + e^d,, + e^d,,)). 



Its Lie algebra structure is the following: the derived series of is 92 = 
{W2,W3,W5,WQ,W7,Ws,Wg), Q3 = {W2) , where 52 is the Heisenberg 
algebra again f) = f)i © f)2 (the indices denote the grading) given by 
the symplectic form on ()i = {W3, W^, Wq, W7, Ws, Wg) with values in 

h = {W2): 

[W3, W-r] = -2e^W2, W^] = 2^W2, 
[We, Wj] = 2W2, [Ws, Wg] = -A€'W2 

(normal form is achieved by the shift of (PVe^W^r) by 2^(^/3,^5))- 
Then the 2-dimensional right extension from f) to g is achieved via 
grading element W4, ad(W4)|[,j. = ■ id, and the derivation 

Wi = (g) 6*5 + 1^5 (g) 6^6 + W'e ® ^7 - eW"8 ® 6*8 + eW^9 ® 619. 

Let us now demonstrate the sub-maximal property. 

Theorem 7. There exists no rank 2 distribution in with symbol of 
general position (i.e. growth vector being (2,3, 5,6)j that possesses a 
10- dimensional symmetry algebra. 

To demonstrate this we will use Corollary [61 

Proof. The maximal symmetry algebra, corresponding to (Q, was cal- 
culated in |AKj : the graded Lie structure is 



= 0-4© 0-3 © 0-2 © 0-1 © 00 © 01 

= {Zo) © {Yo, Z,) © {Z2) © {So, Zs) © (^1, R, Z4) © (^2, Z,) 
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and the commutators are (we list only non-trivial ones) 

[5*0, ^i] = 5*0, [5*0, 5*2] = 25*1, [5*1, S2] = S2, 

[So, Zi] = Zi_i, [Si, Zi] = {i- ^)Zi, [S2, Zi] = + 5)Zi+i, 

[Zo, Z,] = 2Yo, [Zi, Z4 = -2Yo, [Z^, Z^\ = 2Yo 

[Yo,R] = Yo, [Z,,R] = \Z,. 

Its Levi decomposition is 

Q = sh+m^ = {Si)®{R,Yo,Zj). 

It follows that any 10-dimensional graded subalgebra shall contain the 
8-dimensional space (5*1, Yq, Zj), to which a 2-dimensional subspace in 
(5*0, 5*2, R) shall be added. 

This can be reduced to removing from g either R or 5*2 (in fact, 
internally any subalgebra of SI2 is conjugated to {So,Si), but in our 
case the semi-simple part enters with the graded representation, and 
so there are more cases; however e.g. removal of 5*0 is much simpler and 
we restrict to the most complicated cases). This is a 10-dimensional 
subalgebra C g, but we need to check if it has a deformation in the 
spirit of Corollary [6l 

The first choice f) = {Si,YQ, Zj) is easy: The SI2 subalgebra is rigid 
upon deformation f) ^ /i, as well as its module = (Yq, Zj). The Lie 
algebra structure on h = SI2 +xn^ is given by a choice of sl2-equivariant 
morphism A^m^ — )■ h. 

Denoting by V the tautological (2D) representation and by e the 
trivial one, we have m'^ = S^V © e and consequently A^m'^ = S^V © 
S^V © S'^V © e. Notice that the adjoint representation, equivalent to 
S^V is not among the summands. Thus by Schur's lemma the only 
morphism is the projection to S^V © e (given by two coefficients). 

Therefore the only possible Lie algebra structure is given by the 
commutators [Zi,Zj] = XijYo and [^i,lo] = cZi (the brackets with 
SI2 are the same as in g). Acting on the first equation by ad(5'i) we 
obtain Xij = unless i + j = 5, and acting on it by ad(5'o) we get 
Ao,5 = — Ai^4 = A2,3 and this can be normalized to 2 (it is non-zero by 
the deformation constraints). Now the Jacobi identity for the triple 
{Zi, Z^-i, Zk) yields c = and we recover the structure of (). So no 
non-trivial deformation is possible 

The second choice I) = {So, Si,Yo, Zj, R) is more complicated because 
the semisimple part is gone. Let us start by calculating the usual defor- 
mation. The operator ad(S'i) has spectrum { — 1, 0, 0, 0, ±|, ±|, ±|}. 
The simple eigenvalues will be perturbed and we can normalize —1 to 
be fixed. This restores the solvable subalgebra (5*0, Si). 

Next the Jacobi identity yields [5*1, [Sq, Z,]] = (Aj — l)[S'o, Zi] provided 
[5*1, Zi] = XiZi. This implies [5*0, Zi] = Zi_i and [Si, Zi\ = {i-\ + X)Zi 
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for some A. We define Yq = ^[Zq, Z^] and then calculate if A 7^ but 
small: [S'o,lo] = 0, [5*1,10] = 2AYo- We can proceed and get in this 
way a non-trivial deformation, but it will not be of the type described 
in Corollary El 

So let us use the assumption on filtration, namely that after passing 
to grading we have a monomorphism f) — ?■ (the filtration in q is 
Fi = ®k>iQk)- This yields A = 0, and then it is not difficult to deduce 
that the brackets for [Zi, Zj] are the same as in g. 

Indeed, since ad{Si)[Zi, Zj] = {i + j — 5)[Zi,Zj] the latter commu- 
tator can be non-zero only for i + j = 4 or 5. Applying ad(5'o) to 
[Zi+i,Zj] = with z + j = 5 we get [Zi,Zj] = -[Zj+i, from 
where [Zi,Zrj-i] = (— l)*21o- Applying ad(5'o) to this starting from 
z = we get [Zi, Z^_^ = 0. 

Now by Leibniz rule it follows that [Si, Yq] =0, and so we restore all 
commutators relations from q for the subalgebra {Sq, Si, Yq, Zj). 

It remains to add R. By filtration reason the following relations 
should hold for some constant coefficients: 

[So,R] = aZ, + f3S^+-fR + 6Z,, [S^,R] = aZ,, [Z,,R] = 0. (8) 

Applying to the last equality ad(S'o) several times (and using the first 
equality) we successively get formulae for [Zi,R], which we do not 
reproduce all. When i = — 1 (Z_i = 0) we obtain 

- 37Z0 - §7(7/3 - 37)^1 + 57^(7/3 - 7)^2 - |7'(21/3 - 57) 

+ 7'(14/3 - 37)^4 - i7'(5/3 - 7)^5 - 2{a + 6-f)Yo = 0, 

which implies a = 7 = 0. 

Now applying ad(5'o) to the middle equality in ([8]) we obtain (3Si + 
= (7^4, so that /3 = 0, cr = |5. The last number can be nonzero, 
but it is removed by the change i? i-> i? — ^crZ^. This restores all the 
commutators and so we get h = I) G g. Thus no non-trivial deformation 
exists. □ 

Thus we see that the rank 2 distribution in corresponding to 
([7]) actually represents a sub-maximal case. The structure of maximal 
symmetry is unique according to \AK\ IDZj , but this is not so for the 
sub-maximal case; here are some other models representing rank 2 
distributions in with 9-dimensional symmetry algebra: 

y' = {z"'f + e\z'f and also y' = {z"'f + 

Another interesting series of symmetric models corresponding to rank 
2 distributions in is 

y' = {z"T. (9) 
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For generic m the symmetry algebra is 7- dimensional, but for some 
values like | and | it is 8-dimensional, and these special systems to- 
gether with elliptic and hyperbolic Monge equations from |AK] yield 
sub-submaximal symmetric models of 2-distributions in M^. 

In higher dimensions the maximally symmetric Monge equations are 
given by 

y' = {z^""^?. 

They represent rank 2 distributions in M"+^ with the symmetry algebra 
of dimension 2n + 5. The sub-maximal case is realized by any of the 
equations 

with < j < n; its symmetry algebra is (2n + 3)-dimensional. Thus in 
this case the gap is 2. 

For other equations, like elliptic and hyperbolic Monge equations 
|AKj . the gap takes the minimal possible value 1. 

6. Conclusion 

We have observed that the gap phenomenon exists (i.e. the lacune 
exceeds 1) if the maximal symmetry algebra has a semi-simple part; 
the larger is the dimension of the latter the larger is expected the gap. 

For geometric structures associated to distributions (in which case 
the maximal symmetry algebra is graded and is given by the Tanaka 
theory) we have been able to explain the phenomenon and presented a 
tool to perceive the gap. 

Also in the latter case the maximal symmetry model (as well as its 
algebra) is unique, though it is not true in general (e.g. for Riemannian 
metric with maximal amount of Killing fields). Sub-symmetric models 
are seldom unique. 

Remark also that maximal symmetry algebras act transitively on the 
manifold where the structure lives (in other words the maximal models 
are homogeneous). This still holds for the sub-maximal models related 
to distributions, e.g. in the discussed cases ([5]) and ([7]). In general 
sub-maximal situation even this is not always true (compare again the 
case of local Killing fields on surfaces). In the lower-dimensional case 
like sub-submaximal (jH]), and also for Cartan's involutive systems with 
6-dimensional algebras [Cl p. 170], this property fails. 

Understanding of maximal and sub-maximal symmetric models in 
general still remains an interesting open problem. 
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